Neural basis of reinforcement learning and decision making.
نویسندگان
چکیده
Reinforcement learning is an adaptive process in which an animal utilizes its previous experience to improve the outcomes of future choices. Computational theories of reinforcement learning play a central role in the newly emerging areas of neuroeconomics and decision neuroscience. In this framework, actions are chosen according to their value functions, which describe how much future reward is expected from each action. Value functions can be adjusted not only through reward and penalty, but also by the animal's knowledge of its current environment. Studies have revealed that a large proportion of the brain is involved in representing and updating value functions and using them to choose an action. However, how the nature of a behavioral task affects the neural mechanisms of reinforcement learning remains incompletely understood. Future studies should uncover the principles by which different computational elements of reinforcement learning are dynamically coordinated across the entire brain.
منابع مشابه
Integration of Reinforcement Learning and Optimal Decision-Making Theories of the Basal Ganglia
This article seeks to integrate two sets of theories describing action selection in the basal ganglia: reinforcement learning theories describing learning which actions to select to maximize reward and decision-making theories proposing that the basal ganglia selects actions on the basis of sensory evidence accumulated in the cortex. In particular, we present a model that integrates the actor-c...
متن کاملReinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making.
The computational framework of reinforcement learning has been used to forward our understanding of the neural mechanisms underlying reward learning and decision-making behavior. It is known that humans vary widely in their performance in decision-making tasks. Here, we used a simple four-armed bandit task in which subjects are almost evenly split into two groups on the basis of their performan...
متن کاملAn Unsupervised Learning Method for an Attacker Agent in Robot Soccer Competitions Based on the Kohonen Neural Network
RoboCup competition as a great test-bed, has turned to a worldwide popular domains in recent years. The main object of such competitions is to deal with complex behavior of systems whichconsist of multiple autonomous agents. The rich experience of human soccer player can be used as a valuable reference for a robot soccer player. However, because of the differences between real and simulated soc...
متن کاملBeliever-Skeptic meets Actor-Critic: Rethinking the role of basal ganglia pathways in decision-making and reinforcement learning
Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, USA Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA * Correspondence: Kyle Dunovan, Department of Psychology, University of Pittsburgh, 615 LRDC 3939 O'Hara St, Pittsburgh, PA 15260, U...
متن کاملNeural and neurochemical basis of reinforcement-guided decision making.
Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different...
متن کاملLearning and Decision Making in Human During a Game of Matching Pennies
To gain insights into the neural basis of such adaptive decision-making processes, we investigated the nature of learning process in humans playing a competitive game with binary choices, using a matching pennies game. As in reinforcement learning, the subject’s choice during a competitive game was biased by its choice and reward history, as well as by the strategies of its opponent. Furthermor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Annual review of neuroscience
دوره 35 شماره
صفحات -
تاریخ انتشار 2012